EXISTENCE AND UNIQUENESS OF THE SCATTERING 

SOLUTIONS 
IN THE EXTERIOR OF ROUGH DOMAINS 



ALEXANDER G. RAMM AND MARCO SAMMARTINO 

Abstract. A simple and short proof is given for the existence and uniqueness 
of the solution to the obstacle scattering problem under weak smoothness 
assumptions on the obstacle. The Robin, Neumann and Dirichlct boundary 
conditions are considered. 



1. Introduction 

In this paper we study the scattering problem in the exterior of a rough bounded 
domain. This problem was investigated in where it was assumed that the 
potential had compact support. The goal of this paper is to relax this hypothesis 
and to give a simple and general method of proof which is simpler than the earlier 
known. The assumptions on the coefhcients of the differential operator are also 
relaxed. We prove the results, similar to those in ||], assuming that the potential 
decays at infinity at the power rate which depends on the space dimension. We 
discuss the 3-D case (n = 3), but the arguments are similar in the n-dimensional 
case. By this reason in many places we keep n in the formulation of the results and 
assumptions. Estimates (3.18), (3.19), (4.1), (4.2) and (4.16) are given for n = 3. 

The assumptions on the smoothness of the domain are minimal and include all 
the previously studied cases and probably all of the cases of interest in apphcations. 

The plan of the paper is as follows. In the rest of this Section we introduce 
some notations, the function spaces we work with, and give the statement of the 
scattering problem. In Section 2 we prove the uniqueness of the solution of the 
scattering problem. In Section 3 we prove the existence of the solution assuming 
that the potential has compact support. In Section 4 we assume a power decay rate 
of the potential and prove the existence of the scattering solution. 

Our results are stated and proved for the broader class of domains than in the 
literature, see e.g. 0| and | p^ . In particular Lipschitz domains form a proper 
subset in the class of domains we study. An inverse obstacle scattering problem in 
a class of rough domains was studied in [|lo| . 

The basic ideas of our method are simple: first, we prove that the operator of 
the problem under consideration is selfadjoint. This is done by using the fact that 
every closed symmetric densely defined semibounded from below quadratic form 
on a Hilbert space defines a unique selfadjoint operator whose domain is dense 
in the domain of the quadratic form. The assumptions (1.4) and (1.5) (see below) 
concerning the roughness of the domain guarantee that the corresponding quadratic 
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form is semibounded from below and closed. The case of the Dirichlet boundary 
condition is the simplest one, and in this paper we mostly deal with the Robin 
boundary condition. In the simplest case of the Dirichlet boundary condition no 
assumptions are needed on the roughness of the obstacle: any compact domain is 
admissible. The reason is simple: for the compactness of the embedding Hq{Dji) 
L'^{Dii) no assumptions on D, except boundedness of D are needed, while for 
the compactness of the embedding H^{Dfi) — > L'^{Dr) (see next section for the 
notations and condition (1.4) below) some assumptions concerning the roughness 
of the boundary of D are necessary. Necessary and sufficient conditions for the 
compactness of the above embedding operator are known Q, For the Robin 
boundary condition in addition to (1.4) assumption (1.5) is needed. 

Secondly, we prove that the solution to the problem with complex spectral pa- 
rameter fc^+ie, e > 0, converges, as e — » 0, to the solution of the scattering problem. 
The convergence holds in suitable local and global norms. 

The underlying idea is to use the Fredholm property of the problem in a properly 
chosen pair of normed spaces. 

1.1. Notations and assumptions. The following are the notations used in this 
paper. 

By D C i?" we denote a bounded domain, D' stands for its complement, D' := 
i?" \ _D, := D' n Bjf , Bjf denotes a ball with radius R such that Bn D D, and 
B'jj is the complement of Bj^ in ii". 

By aij{x), X G Z?', we denote the elements of a real- valued symmetric matrix 
satisfying the following hypotheses: 

(1.1) 3c, C > such that c\t\'^ < a^j{x)Utj < C\t\^ Vt e C" ,yx e D' . 



In (1.1) and below the summation over the repeated indices is understood. One 
has: 

(1.2) aij{x) = 5ij when |x| > i? , 

and the coefficients aij{x) are assumed Lipschitz continuous. This assumption 
implies the validity of the unique continuation principle for the solutions to elliptic 



equation (|l.8| ) below. 
Let 



lu :— —dj {aij{x)diu) 



Assume 
(1.3) 



77 ^ 

q{x)^q{x), q{x)eLl^{Rn, P>^, q{x) e L°^\S), 
^ (i^|^|2)./2 ' \x\> R, s>n, n>S, 



where S C D' is a neighborhood of the boundary S := dD. The bar stands for 
complex conjugate. The assumption s > n is weakened in some of the statements 
of this paper: for example, in Proposition 2.2 below it is assumed that s > 1. 
However, the assumption s > n, n — 3, is used in section 4. In the scattering 
theory is developed under the assumptions that Uij = Sij, the obstacle is absent, 
and q{x) satisfies less restrictive assumptions than (1.3), essentially it is assumed 
that s > 1. Therefore it is likely that the results of our paper can be obtained 
under this weaker assumption. However, much additional technical work is needed 
to obtain such results. We are emphasizing the methodology of handling rough 
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boundaries in this paper and discussing of the wider class of potentials would lead 
us astray. 

Let 

Lu lu + q{x)u . 

Let S :~ dD. Our main assumptions concerning the smoothness of D are: 
(1.4) The imbedding i : H'^ [D r) {D r) is compact , 



(1.5) The trace operator r : [D r) {S) is compact , 

where in the definition of L'^{S) the integration over S is understood with respect 
to the n — 1-dimensional Hausdorff measure In particular, assumption (1.5) 
implies that the n — 1-dimensional Hausdorff measure of S is finite, that D has 
a finite perimeter (see [Q, p. 296), and that Gauss-Green formula holds in D for 
functions in BV{D) space, which consists of functions u G Lj^^{D) such that Vu, 
understood in the sense of distribution theory, is a signed measure (a charge) in D. 
See Q for the exact formulation of the Gauss-Green formula for such domains and 
such class of functions. 
Let 

ujv 9nu :— aij{x)diuNj , 

where Nj is the ]-th component of the normal to S pointing into D. The definition 
of the normal for rough domains is not discussed here because in our formulation of 
the scattering problem (see (1.11)-(1.12) below) the notion of normal is not used. 
One can find the definition of the normal in the sense of Federer in p. 303. 

In this paper we do not define the class of rough domains explicitly, but isolate 
property (1.4) or properties (1.4) and (1.5) as defining properties. In |^ necessary 
and sufficient conditions on S, the boundary of D, are given for these properties to 
hold. In formulas below in which the surface integrals appear, e.g., (1.11), (2.1), 
(3.1), (3.2), etc, the integration measure ds is the n — 1-dimensional Hausdorff 
measure defined, for example in p. 37. In Q it is proved that for rectifiable 
surfaces (the class of these surfaces is much broader than the class of Lipschitz 
surfaces) the n — 1-dimensional Hausdorff measure is equivalent to the measure 
generated by the elements of the surface area. 

Given an L°°{S) real-valued function (t(s), s £ S, one defines the operator F-'^: 

r^u{s) := un{s) + ct(s)u(s), s & S . 

Introduce the following operators: 

T'^u{s) :— u{s), s E S , 
F^u(s) := UAr(s), s £ S . 

Let Mo :— exp {ika ■ x), a E 5*"^^, where 5"^^ is the unit sphere in R", fc > 0, and 



V := u — uq 



4 



ALEXANDER G. RAMM AND MARCO SAMMARTINO 



1.2. Function spaces. Let 

(1.6) {u, v) / uvdx . 

JD' 

On (D') define the following bilinear form, [•,•]: [D') x (D') ^ C. 

(1.7) j aijdiudjvdx + {u,v) . 
We use the following spaces: 



D' 



Definition 1.1. The space Lf^^{D') is the space of functions f such that, \fr > R, 

feL\Dr). 

Definition 1.2. The space Hl^^{D') is the space of functions f such that, ^fr > R, 
f e H^{Dr), where H\Dr) is the Sobolev space. 

Definition 1.3. The space Hq{D') is the closure in H^{D') norm of the space 
of functions f G H^{D') vanishing near S. The set of functions which belong to 
H^lDr) for any r > R is denoted by Hqi^^{D'). 

Definition 1.4. The space H^{D') is the space of functions f G H^{D') vanishing 
near infinity. 

Definition 1.5. The space Hq{D') is the space of functions f G Hq{D') vanishing 
near infinity. 

Definition 1.6. The space := H^{D'), £ = 0,1, is the space of functions f G 
H^^^{D') with finite weighted L^{D')-norm, for example the norm in with i = 1 
is defined as follows: 



lis- f {i + \x\y^'{\f\' + \vff)dx<^ 

JD' 



1.3. Statement of the problem. We study the following problem: 

(1.8) Lu-k^u^O \tlD' , 

(1.9) r-^u^O inS", 

(1.10) lim / \vr-ikv\'^ds^Q, 

where v = u — uq, uq — e**^"'^, a G S*""^ is given, fc > is fixed, and X = R 
(the Robin boundary condition) , or X ^ N (the Neumann boundary condition) , or 
X — D (the Dirichlet boundary condition) . We mostly discuss the Robin boundary 
condition. The other cases can be treated similarly. The Neumann boundary 
condition is a particular case of the Robin boundary condition {a{s) = 0). The 
Dirichlet boundary condition is the simplest: it does not require any smoothness 
assumptions concerning the boundary S, only the boundedness of D is required. 
For the Neumann boundary condition only assumptio n (|l.4| ) is needed. For the 
Robin boundary condition both assumptions (1.4) and (1.5) are used. 
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1.4. The weak formulation of the scattering problem. Here we introduce 
the weak formulation of problem ( |l.8| )-(1.10). 

Definition 1.7. We s ay th at u E H}^^^,{D') Ci H^g{D'), s > 1, is a weak solution of 
the scattering problem with X = R (the Robin boundary condition) if 

(1.11) / [aijdiudj(p+ {q-k'^)u(p\dx+ I au(pds = Vip e {D') , 



r — >oo 



(1.12) lim / \vr — ikv\ ds = 0, where v — u — uq 

' \x\—r 



Definition 1.8. We s ay th at u £ H^,^^ {D')r\H^^{D'), s > 1, is a weak solution of 
the scattering problem {l.t )-( I.IC ) with X — D (the Dirichlet boundary condition) 
if 

(1.13) / [a,jdiudjf>+{q-k'^)u^]dx = Vip e Hq {D') , 

Jd' 



r — *oo 



(1.14) hm / \vr — ikv'i^ds — where v — u — . 

I\x\=r 

2. Uniqueness theorem 



In this section we prove uniqueness of the sohition to problem (1.8)-(1.10). We 
first state the following known results: 

Proposition 2.1. fjlj], p. 227) Suppose u is a solution of Eq. ^1.^ ) vanishing on 
an open subset of D' . If aij{x) are Lipschitz and q{x) e L^^^{R^),p > >3, 
then u = in D' . 

The above Proposition is called the unique continuation principle. 

Proposition 2.2. (^, p. 25) Suppose that ( fT^ j and ( [T^ hold, s > 1 in ^Tdj ) and 

k>0. Ifue Hl^{B'j^) and 

(2.1) / [diudiCp+ {q{x) -k'^)u(p\dx V(^Gi?o(S^), 

(2.2) lim / |Mpds = 0, 

then u = Q outside Bji. 

In 1^, p. 25, it is assumed that q{x) = 0. In the general case the result follows 
from a theorem of T.Kato (Q) which says that any solution to equation (1.8) in 
B'j^, which satisfies (2.2), vanishes in B'j^ if /c > and |a;||g(a;)| — * as \x\ — > cx). It 
is not necessary to assume q real-valued in Kato's theorem. 

We now prove a Lemma used in the proof of the uniqueness of the solution of 
the scattering problem. 

Lemma 2.1. Suppose W satisfies ( [j. J j] /). Then 

(2.3) / {WWr - WWr) ds^O , r>R. 

J |a:| 
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Proof: Take a cut-off function h{r) e C°°{R) such that < h < 1 h{r ) = 1 
when r < 1/2, h{r) — when r > 3/2, h is monotonically decreasing. In (1.11) take 
(f = Wh {{\x\ — ro)/5), with tq > R, and S > 0. Then take the complex conjugate 
and subtract. Using (L2), one gets: 

(Wd^W -Wd^W)d^h{{\x\ - ro)/d)dx ^0 . 



D' 

If one takes the limit 5 ^ in the above relation, one gets the desired result. Taking 
this limit, one uses the interior regularity of W: this regularity is a consequence of 
equation (1.11) and of the known interior elliptic regularity results. 
We now state the main result of this Section. 

Theorem 2.1. Suppose ui and U2 are the weak solutions of the scattering problem 
with the Robin (Neumann, Dirichlet) boundary condition. Then ui =U2. 

Proof: We prove this Theorem in the case of the Robin boundary condition. 
The cases of the Neumann and the Dirichlet boundary conditions can be treated 
similarly. Define W :— ui — U2- One has: 



(2.4) 
(2.5) 



D' 

lim 



aijdtWdjip + {q- k^) Wip] dx 
\Wr-ikW\'^ds = . 

\x\—r 



aWifds = VipeH^ {D') 



Equation (^.5|) can be written as: 



lim / {\Wr\^ + k^\W\^) ds + lim ik [ {WrW - WrW) ds ^ 

'^°°J\x\=r J\x\=r 



\x\—r 



Since W satisfies (2.4), Lemma ETi applies, and the above relation implies 



lim 



\Wrds = 



|a;|— r 



which is condition (2^) of Prop osition 2.2 . Moreover, fr om (p.4| ) and ( |1.2| ) it follows 
that W satisfies condition (2.1). Therefore Proposition 2.2 implies W = outside 



Ba- Then one applies Proposition 2.1 and concludes that W = in D' . Theorem 2.1 
is proved. □ 

We wish to prove the existence of the solution of the scattering problem. Let us 
reduce the problem to the one for a function which satisfies the radiation condition 
at infinity. 

Take a cut-off function C £ C°°{R), such that < ( < l,C = Oina neighborhood 
of D and C = 1 outside Br for some r > R, and define 

w := u — (uq. 



If u solves the scattering problem (1.8)-(1.10), then w solves the following problem: 
(2.6) Lw -k^w = f := {L - k^) (Cuo), 

(2.7) 



T^w = 0, 



(2.8) 



lim 



\wr — ikw^^ds — 0. 



In Section 3 we prove that the above problem has a solution. Theorem 2.1 implies 
that this solution is unique. 
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3. Existence for compactly supported potential 



In this Section we prove that the scattering problem (1.8)-( r3o| ) with a com- 



pactly supported potential, q{x) if > a, has the unique solution. We look 
for a solution of the form u ~ w + C^o, where C is a cut-off function (defined above 



formula (2.6)) and w satisfies (p.6|)-(2.8). Let us prove that problem (|2.6|)-(2.8) 
has a solution. 

3.1. Existence for the equation with the absorption. Consider the weak form 
of the scattering problem: 

Let e>0. Find w e (D') D H]_,{D'), s > I, such that: 

(3.1) 

/ [aijdiwdj(fdx + (g — fc^ — ie) wp] + / awipds — (/, ip) Vip G {D') , 
J D' J s 

In the space H^{D') C L^{D') consider the following bilinear form: 



(3.2) Bj[u,v] :— [u,v] + j{u,v) + / auvdS + {qu,v) := [u,v]^ + {qu,v) 



S 



I k 1 /2 

where [u, v] is defined in ( |1.7D and 7 > is chosen so large that the form [u, u]j 
defines the norm equivalent to H^{D'). We use here assumption (1.5), which implies 
that the boundary integral in (3.2) can be estimated by the term 
c||M||ffi(_DH)||'y||_f/i(_DH)- One could omit assumption (1.5) and change the space 
in which the solution is sought, to the space with the norm containing the ad- 
ditional term ||w||/,2(5), where the measure used in the definition of L^{S) is the 
n — 1-dimensional Hausdorff measure. Then one could use assumption (1.4), do not 
use assumption (1.5), and assume that S has finite perimeter (see |l^). A set has 
finite perimeter if the gradient (in the sense of distribution theory) of the charac- 
teristic function of this set belongs to the space BV{D). This space was mentioned 
below formula (1.5) (see also ||l^, p. 152). 



If X — D m (1.9), then the term auvdS is absent in the definition of 



u, v\. 



in (3.2) and assumptions (1.4) and (1.5) can be dropped. 

If X = TV in (1.9), then the term J^auvdS is also absent in the definition of 
in (3.2), assumption (1.4) is used and assumption (1.5) is not used. 

If X — R in (1.9), then both assumptions (1.4) and (1.5) are used. 

Assumption (1.4) allows one to conclude that (3.5) implies (3.12) (see below) in 
the case of Neumann or Robin boundary conditions. 

Assumption (1.5) allows one to conclude that (3.5) implies that the term Jg aipn<f dS 
converges and can be estimated by the i?^(Z?^)-norm of ipn for any test function 
(fi in (3.14) (s ee b el ow). 

Assuming ( |l.l| )-(1.3), one has: 



Lemma 3.1. The form Bj[-, ■] is continuous in H^{D') x H^{D') and for all suf- 
ficiently large 7 > there exist (3j,j = 1, 2, such that 

Pi\\u\\l<B4u,u]<P2\\u\\l /3i>0. 

Proof: One has | q\u\^dx\ < c{R)\\u\\l if (O) holds. Indeed, if u e H^{Br), 



then, by the Sobolev embedding theorem, one has u G L^^{Bji). By Holder's 
inequality, 

q\u\^dx 



Br 



< \\l\\LP{BR)\\u\\l2p'^Ba)' 



8 



ALEXANDER G. RAMM AND MARCO SAMMARTINO 



where p' := Choose p' < Then p > f • If p > § and u G H^{Bji), then 

I /g^ gjupda;! < c(i?) I |w| If, as claimed. Moreover, since the embedding i/^(Z?i^;oc) 
L^P [Djiioc) is compact for p' < it follows from (1.3) and (1.4) that 



q\u\ dx 



C^(^)lklli2(DH) 



for any > 0, however small (see [0). Assumption (1.5) implies 



a\u\'^ds 



□ 



for any v > Q, however small. Lemma 3.1 is proved. 

It follows from the above lemma that the norm [B'y{u,u)Y/'^ is equivalent to 
H^{D') norm, the form is closed, symmetric and densely defined in the 

Hilbert space H := L^{D'). Therefore this form defines a unique self-adjoint non- 
negative operator L in H = L^{D') with domain dense in H^{D'). The points z 
with 3z 7^ do not belong to its spectrum. Thus problem (3.1), with e > has a 
unique solution in H^{D'). We have proved the following: 



Proposition 3.1. Problem (3.1) has a unique solution £ H^{D'). 

In the proof of the above Proposition we have not used the compactness of the 
support of the potential q{x) and gave the proof valid for q{x) satisfying (1.3). 

3.2. The limiting absorption principle. In the above subsection we have proved 
that for each e > 0, problem (3.1) admits a solution w^. In this subsection we shall 
prove that one can take the limit for e going to zero, and get the solution of (2.6)- 

(ID- 

We first prove the following fundamental Lemma. 

Lemma 3.2. Suppose ipn £ Hl^^{D') D H^g{D'), with s > 1, and, in the weak 
sense, 

(3.3) Lipn - {k^ + i£n) = 

(3.4) r«7A„ = 0, 

with En I 0, /i„ e L^{D') have compact support and hn —> h in L^{D'), where h 
has compact support. Moreover suppose 

(3.5) ||^„||o,-s <M, 

where M > is a constant independent of n. Then there exists a subsequence of 
{^"}neiV' denoted again by {V'n}„giV' '^"'^ a ijj e H^^^{D')nH}_g{D'), with s > I, 
such that: 

(3.6) V-n ^ V' strongly in H^,,{D') , 

(3.7) strongly in H"_,{D') , 

with ip solving the limiting problem: 

(3.8) LiP-k^iP = h, 

(3.9) r^v = 0. 

Moreover 

V'r — ikipl'^ds = 0. 



(3.10) 



lim 

7' — >OQ 



\x\-- 
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Proof: 

Step 1: Con vergence of 4'n in Ll^^{D') and weak convergence in H^{Dr) Vr > R. 
Due to (3^), there exists a subsequence G H^^^D') which converges weakly 
in LLP'): 



(3.11) V'n^V' weakly in LL(-D')- 

Let us now prove that this subsequence ipn is bounded in Hl^^{D') uniformly with 
respect to n. If this is proved, then one gets: 

(3.12) — weakly in H^^^{D'),ipn — > 'ip strongly in L^{Dr)yr > R, 

for a subsequence, denoted also by ijjn- To prove that ||V'n||//i(Dr) < c(r) Vr > i?, 
take in the weak formulation of (3.3), similar to (3.1), the test function (p := 'ipn(3{x), 
where P{x) is a cut-off function, < l3{x) < 1, P{x) — 1 for < r, f3{x) — for 
a;| > r + 1, r > R. It then follows from the analog of (3.1) (see (3.13) below) 
that ||'0n||_ffi(nr) < c(r) Vr > R, where c(r) > is a constant independent of n, as 
claimed. 

Similarly one can prove that, if s > 1 then 

This is done as follows: write (3.1) with w — ipn and subtract from (3.1) with 
w = ipm- Use (1.1), (3.7), (3.12), (3.16)-(3. 18) to get the desired conclusion. 
If Ipn is a weak solution of the problem ( |3.3[) ^ (|3.4| ), one can write: 



I [aijdi-tpndjipdx + {q-k^ - ie„) ipn^p] + / aipn^ds = (/i„, ip) 

{6A6} J j^i _ Jg 

yip e iJi {D') . 

Using ( ^.11| ) and ( [3.12 ) one can pass to the limit in the above equation and get: 

/ [aijditpdjipdx + {q- k^) ip^] + / aip^ds = {h, ip>) 
['^■^^) JD' Js 

Vip e iJi (£>') . 
Step 2: Convergence of ipn in H^^^{D'). 

By the elliptic regularity, one concludes that ipn and ip are in Hf^^{D'). Moreover, 
due to the density of H^{D') in L'^{D'), it follows from < ^A^ and ( |3J^ ) that Vn 
and Ip satisfy (almost everywhere in D') ( |3.3| ) and ( |3.8| ) respectively. 

Subtract (|3.8|) from ([3.3[), and use the elliptic estimate to get: 



(3.15) 

yDi CC D2 CC D' , 

where c > is a constant which depends on Di and D2 but not on n. This estimate 
proves (|3.6| ), since e„ ^ and ||f/'n||L2(£)2) is bounded. 

Step 3: The re pres entation formula and the radiation condition. 
If Ipn satisfies (3^), assumption (1.2) holds and q{x) = for |a;| > i?, then the 
following representation formula holds: 

(3.16) %pn{x) ^ I [ipn{s)dNgE^{x,s) - ge,^{x,s)dNi/Jn{s)]ds for x e B'j^ , 
Jsr 
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oWk'-^+ien\x — y\ 



is the Green function of the operator A + (fc + i£„) 



4,'k\x — y\ 

and N in ( 3.16| ) and belo w stands for the normal to Sn pointing into B'^. One can 
pass to the limit in ( 3.16 ) (due to the convergence of V'n in H^^^{D') proved in Step 
2), and get the following representation formula for -0: 



(3.17) 



■0(a;) 



Sh 



where g = 



is the Green function of the operator A + fc^ in R . Equation 



( 3.17 ) implies that ip satisfies the radiation condition ( 3.10 ). 

Step 4- A uniform estimate of the behavior of ipn o,t infinity. 
The representation formulas (3.16) for tpn and (3.17) for tp, imply the following 
uniform estimate for the behavior of ij^n at infinity (in R^): 



(3.18) 



sup (IV'nl + |VV'„|) < T-T for xeB\ 



R ' 



where c > is a constant independent of a; G B'j^. This estimate will be crucial in 
the next Step. Note that (3.12), (3.18) and the estimate < c(r) Vr > i? 

imply that i/i G (£>'), s > 1. 

Step 5: Convergence of ipn in H^^{D') and the conclusion of the proof. 
To complete the proof of the Lemma we have to prove the convergence property 
(^). Estimate (3. IS) and the assumption s > 1 imply: 

(3.19) 



< sup 

B„nD' 



(1 



dx 



\j;\2y/2 

,,nD' (l + N2)«/2 



dx 



iy/2 



2.|2)s/2 



(1 



dx 



\L^(BRnD') 



Anc 



r2 {1 + r'^y/' 



-r dr 



with 7/ > arbitrarily small. In the last step of the a bove estimate we have chosen 
R so that Attc^ dr/{l + r^y/^ < r]/2, and ( 3.11 ) has been used. This proves 
( ^TtI ) in R^. In other space dimensions the proof is analogous. 

With the help of Lemma we prove the follow ing a priori estimate for the 
solutions Ws of the problem (3T). In estimate ( |3.20 ) below we take < e < 1, but 
we could take < e < £oj where Eq > is an arbitrary small fixed number. 



Proposition 3.2. The solution of problem (3A) satisfies the following a priori 
estimate: 



(3.20) 



sup niello,. 

0<£<1 



< c 



Proof: 

We prove this Proposition by contradiction. Suppose ( [3.2C| ) is false. Find e„ \, 
such that 

lke„||o > n . 
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Define tpn ■— ^£„/ll'^e„ l|o.-s- Clearly ipn satisfy all the hypotheses of Lemma 3.2 
with hn = //||ui£^J|o._s, hn ^ in L^(D'). Lemma 3.2 yields that tpn ip where 
ip solves the problem: 



lim / \ipr — ikt/j] ds = . 



By the uniqueness Theorem we get t/j = 0. Bu t th is contradicts to the fact that 
llV'n ~ V'llo.-s and ||-0„||o,-s — L Proposition 3^ is proved. □ 



If We satisfies (3.2C) one can apply the Lemma p3^ to 4'n = We^ for some e„ | 0, 
and wi th / i„ = /. We have therefore proved the existence of a w solving the problem 
(P^)-(2.8) and the main result of this Section: 



Theorem 3.1. Scattering problem (l.t)-(l.lC} with a compactly supported poten- 
tial q has a unique solution u of the form u = w-\-C,Uf). Here w G H^^^{D')C\H^g{D'), 
with s > 1, and C, is a function defined above formula (2.t ). 



4. Existence for a decaying potential 
In this section we prove that the scattering problem ( 



1. 



-(Lie), with a potential 



q e Hi has a solution. We shall prove the existence of the solution in the same 
way we did for the scattering problem with a compactly supported potential. First 
we look for a solution u of the form u — w -\- (uo so that the problem is reduced 
Then we prove the existence of a unique solution for scattering 
Finally we shall prove that one can take the limit e | and get the 



to (^-(2.? 



problem (3.1 



solution of(|J)-(| 



4.1. Existence for the equation with absorption. 



Proposition 4.1. Problem (3.1), with e > 0, has a unique solution G H^{D'). 



The proof of this proposition is the same as the one of Proposition 3.1 



4.2. The limiting absorption principle. In this subsection we prove that the 
solution We of problem (3J^) converges, as e J, 0, to the solution of (|2.6| )-(^). 
The main step is the proof of Lemma 4.3 below. We first state two Lemmas: 



Lemma 4.1. Suppose that \g{x,y)\ < c\x — y\ 
x,y E D' and s > 3. Then 



id \f{x)\ < c(l + |a;|2) 



(4.1) 
Proof: 



9{x,y)f{y)dy 



^x9{x,y)f{y)dy 



< 



X e D'. 
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Let r = \y\, p = \x\, y = r (sin^cos(/>, sin ^ sin 0, cos^), u = cos 6, and let r, 9 and 
be the spherical coordinates. One has 



/ 9{x,y)f{y)dy < I 

Jb'^ JB'^n{v:\y 



\f{y)\ 



< 



<j\<p/2} \x - y\ 



\f{y)\dy + c [ 



dy 



\!{y)\ 



{y. \v\>pI1} \X-y\ 

dy 



dy 



< -r—+2-KC 

\x\ 



dr- 



\y\>p/2} |X - J/l (1 + |y|2) 



du 



< 



+ Ci 



p/2 (l + r2)^/2 
dr 



1 {p^ + r-^ — 2rpu) 

< A. 



1/2 



\x\ J p/2 {I + r'^)^ '^'^'^{r, p) \x\ 

The second integral in (4.1) can be estimated similarly. 

If s > 2 in lemma 4.1, then the argument above yields o(l) as oo, in 

place of term. By a similar argument one can prove that if s > 2 and g = 

AT!\x-y\ ' ^^^^ function h := /g, 9{x,y)f{y)dy satisfies the radiation condition: 
1^1 1 ~ — > as |a;| ^ 00 uniformly in the directions of x. This remark 
does not allow one to replace s > 3 in the assumption (1.3) by s > 2. The reason 
is: if q is not compactly supported, the function / defined by (2.6) contains the 
term q{x)Q{x)uo which decays as 0((1 + |a;p)~i) for large |a;|. If 2 < s < 3, then 
the argument given in lemma 4.1 is not sufficient for getting estimate (4.1). It is 
probable that the basic result, Theorem 4.1 below, can be established for s > 2 in 
(1.3), but some additional argument is needed for a proof of such a result. 

Lemma 4.2. Suppose that \g{x,y)\ < c\x — y\~^ and \f{x)\ < c (l + |a;p) , 
x,yG D', and il) G H^^iD') with s > 3. Then 



(4.2) 



9{x,y)f{y)'il){y)dy 



^xg{x,y)f{y)ip{y)dy 



< 



X G D'. 



Proof: 

Denote := p, \y\ := r, T{x, y) := \x — y\~^{l + |2/P)~*^^ • One has: 



9ix,y)f{y)ip{y)dy 



< 



I \g{x,y)f{y)\^l + \y\''y'\y f m\'{l + \yf) ''^ dy 

JB' JB' 



1/2 



< C 



< Ci 



0,-s 



T{x,y)dy 



1/2 



'Rn{y: \y\<p/2} 



T{x, y) dy 



1/2 



\x\ 



L 



dr- 



p/2 (l + r2) 



'/2 



{y- \y\>p/2} 

1/2 



T{x, y) dy 



1/2^ 



du 



p2 ^j.2 _ 2rpu 



< 
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The second integral in (4.2) can be estimated similarly. 

We can now prove a Lemma analogous to Lemma 3.2 of the previous Section. 



Lemma 4.3. Suppose tpn G H^{D')r\H^^{D'), with s > 3, and, in the weak sense, 
(4.3) Ltpn - {k'^ + i£,i) ipn = hn, 



(4.4) 



r^^n = 0, 



where e„ | 0, /i„ G L^{D'), \hn{x)\ < c(l + |a;p) , s > 3, and hn h in 
L^{D'), where \h{x)\ < c(l + jxp)^"/^. Moreover, suppose 



(4.5) 



0,-s 



< M , s > 3 , 



where M is a constant independent of n. Then there exists a subsequence of 
{V'n}„g7V'' d^'^oted again by {V'n}„g7V' '^^'^ a -ip E H^^^{D') D H^^{D'), such that: 



(4.6) 
(4.7) 



in Hl,{D') 



where -0 solves the following problem: 



(4.8) 
(4.9) 



h, 
0, 



(4.10) 



lim / \ipr — ikt/j] ds — 



Proof: 

Step 1: Convergence of ipn in L^^^{D') and weak convergence of ipn in H^{Dr), 
r> R. 

If (l45|) holds, then 



(4.11) 
(4.12) 



ipn > V' strongly in 

ipn — ^ ■0 weakly in 



LLiD'), 
H^{Dr) Vr>R 



This is proved in Lemma 3.2 



Step 2: Convergence ■0n in iJj^^(Z)'). 
One has 



(4.13) 



ip strongly in H^^^{D') 



This is proved as in Lemma 3.2. 



As in the Section 3, ■(/'n satisfies (4.3) and (4.4), and -0 satisfies (4.8) and (4.9). 

Step 3: The representation formula for V-'n and the radiation condition. 

If il)n satisfies ( |4.3| ) then the following representation formula holds for x G B^: 



i^n{x) 



['ipn{s)dNge„{x, s) - dNlpn{s)ge„{^ , s)] ds 



(4.14) 



9e„{x,y)hn{y)dy 



9eAx,y)q{y)il)n{y)dy , 
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where N in the above formula and below denotes the normal to Sr pointing into 
B'j^. Since 4'n converges in H^^^{D') one can pass to the limit in (4.14) and get: 



[ip{s)dNgix, s) - dNipis)g{x, s)] ds 



Sr 



(4.15) +/ g{x,y)h{y)dy - I g{x,y)q{y)Tp{y)dy . 

•'b'r Jb'„ 

Equation ( |4.15| ) implies that ip satisfies the radiation condition. 

Step 4- A uniform estimate of the behavior o/'0n at infinity. 
As in the case of a compactly supported potential one gets the following estimate 
for the behavior of V'n at infinity: 

(4.16) supdV'nl + iVV^nl) < for xcB'ji, 



where c > is a constant independent of a; G B'j^. This follows from (4.14) and 
( 4.15| ). The additional terms which appear because the potential and the source 
term are not compactly supported, are estimated in Lemmas 4.1 and 4.2, Estimates 
(4.12) and (4.16) imply V € Hl^{D'), s > 1. 

Step 5: Convergence of ipn in H^g{D') and the conclusion of the proof. 
One proves that — V^Ho.-s — * as in Lemma |3^ . This concludes the proof 
of Lemma 4.5 . □ 



Now one gets the following a priori estimate for the solution of the problem 



3.1 



Proposition 4.2. The solution of problem (3A) satisfies the following a priori 
estimate: 



(4.17) 



sup llWello.- 
0<e<l 



< C 



S > 1. 



3.2 



The proof is based on Lemma 4.2 , and is the same as the proof of Proposition 



Let us state the main result of this paper, whose proof is based on the a priori 
estimate ( 4.17 ) and Lemma 4.3: 

Theorem 4.1. Assume that conditions (1.1)~(1.5) hold and a(s) is a real-valued 
L°°[S)- function. Then the scattering problem ^1.^ -(1.1L ) has a weak solution u 
of the form u = w + (uo, with w e H?(D') n H^g{D') , s > 1, w satisfies (3.1) 
and (2.8), C is defined above formula ^2.(\ ), and this solution is unique in the above 
space. 
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